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Abstract —In this paper, we pioneer the study of physical-layer 
security in heterogeneous networks (HetNets). We investigate 
secure communications in a two-tier downlink HetNet, which 
comprises one macrocell and several femtocells. Each cell has 
multiple users and an eavesdropper attempts to wiretap the 
intended macrocell user. Firstly, we consider an orthogonal 
spectrum allocation strategy to eliminate co-channel interference, 
and propose the secrecy transmit beamforming only operating 
in the macrocell (STB-OM) as a partial solution for secure 
communication in HetNet. Next, we consider a secrecy-oriented 
non-orthogonal spectrum allocation strategy and propose two 
cooperative STBs which rely on the collaboration amongst the 
macrocell base station (MBS) and the adjacent femtocell base 
stations (FBSs). Our first cooperative STB is the STB sequentially 
operating in the macrocell and femtocells (STB-SMF), where the 
cooperative FBSs individually design their STB matrices and 
then feed their performance metrics to the MBS for guiding the 
STB in the macrocell. Aiming to improve the performance of 
STB-SMF, we further propose the STB jointly designed in the 
macrocell and femtocells (STB-JMF), where all cooperative FBSs 
feed channel state information to the MBS for designing the joint 
STB. Unlike conventional STBs conceived for broadcasting or 
interference channels, the three proposed STB schemes all entail 
relatively sophisticated optimizations due to QoS constraints 
of the legitimate users. In order to efficiently use these STB 
schemes, the original optimization problems are reformulated 
and convex optimization techniques, such as second-order cone 
programming and semidefinite programming, are invoked to 
obtain the optimal solutions. Numerical results demonstrate that 
the proposed STB schemes are highly effective in improving the 
secrecy rate performance of HetNet. 

Index Terms —Beamforming, femtocell, nonconvex optimiza¬ 
tion, heterogeneous network, physical-layer security, semidefinite 
programming (SDP). 


I. Introduction 

With the rapid proliferation of smart phones, tablets 
and machine-to-machine communications, there is an ever- 
increasing demand for seamless wireless coverage, extremely 
high mobile data rate and reliable secrecy performance 0. 
Aiming to effectively enhance the spectral and/or energy 
efficiency of wireless networks, it has been suggested that the 
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deployment density of various network-nodes should increase 
CD, ED, and smart access-point activation and resource man¬ 
agement are essential to utilize the dense network-nodes 0. 
Therefore, heterogeneous network (HetNet) 0,0 has been 
attracting great research interests, and it is regarded as one of 
the most promising techniques for providing higher network 
capacity and wider coverage. HetNet is supported by various 
types of base stations with different transmit power budgets. 
Macrocell base stations (MBSs) provide public access and 
wide area coverage up to a few kilometers to all the marcocell 
users (MUs). Small cell base stations, such as femtocell base 
stations (FBSs), are typically overlaid on the existing macro¬ 
cells and installed in the building or indoor environment close 
to femtocell users (FUs). It is noted that the network archi¬ 
tecture of HetNet becomes more open and diverse compared 
to the conventional single-tier cellular networks, which makes 
the information exchange more susceptible to eavesdropping. 
Recently, physical-layer security (PLS) has been proposed as a 
family of viable techniques to secure wireless communications 
0, GO, and it also has the potential to tackle the security 
problem encountered in HetNet. 

Traditionally, the security problem in wireless networks 
was mainly studied at higher layers using key-based cryp¬ 
tographic methods a. This conventional wisdom relies on 
the assumption that the eavesdropper is not computationally 
powerful to break the secret key. However, as the computa¬ 
tional capability of wireless devices develops rapidly, perfect 
security can be hardly guaranteed with the key-based solutions. 
It is reasonable to argue that security measures should be 
invoked at all layers where they can be implemented in a 
cost-effective manner. Notably, the physical layer has remained 
almost ignored for security in the past. The basic idea of PLS 
is to exploit the randomness of wireless channel for secure 
message transmission flOl . The authors in 0, ED, E2 
investigated the PLS in single-antenna fading channels. Since 
then, the secure communication in multi-antenna channels has 
been extensively studied lfl3l — fl9l and in particular, practi¬ 
cal and robust multi-antenna secrecy beamforming schemes 
were investigated in ED very recently. Secure broadcasting 
with more than two receivers were considered in El-El. 
Other related works in the contexts of the multiple-access 
channel with confidential messages l23l . the multiple-access 
channel wiretap channel l24l . and the cognitive multiple- 
access channel with confidential messages lf25il have also been 
reported. Recently, there are growing research interests in the 
secrecy communication over interference channels, where the 
interference may be potentially exploited for improving the 
secrecy performance. More specifically, in (26l . the authors 
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studied the inner and outer bounds for the secrecy capacity 
regions of a two-user interference network where the receivers 
are potentially eavesdroppers. The secrecy rate of a two- 
user interference network with an outer eavesdropper was 
investigated in urn The MIMO Gaussian interference channel 
with confidential messages was studied in |[28l using game- 
theoretic approach. The authors of |29) addressed the problem 
of minimizing the transmit power with imperfect channel state 
information (CSI) in a AT-user multiple-input single-output 
interference network, and the so-called "S-procedure" was 
applied. It should be noted that the existing works on PLS 
mainly focus on traditional network architectures, and the 
research on PLS for HetNet is still largely missing. 

Because of the densely overlaid network architecture, there 
is ubiquitous interference of various types existing in HetNet 
E3- From the viewpoint of PLS, deliberately introducing 
interference can be beneficial for the secrecy rate performance 
of the system itTOl . Inspired by this insight, the interference 
should be utilized, rather than avoided, to improve the secrecy 
rate in HetNet using techniques such as proper spectrum 
allocation and cooperative beamforming. To elaborate a little 
further, motivated by the inter-cell interference coordination 
techniques ED-E3, spectrum allocation can be rearranged 
dynamically in conjunction with various levels of cooperation 
between the network nodes, such as the MBS and FBSs, 
to generate the desired co-channel interference (CCI) to the 
eavesdropper. As a result, judicious cooperative beamforming 
schemes may be designed to cope with CCI for the sake of 
improving the secrecy rate performance in HetNet. 

In this paper, a two-tier downlink HetNet system is consid¬ 
ered, where MBS and FBSs serve the corresponding legitimate 
MUs and FUs, and a MU acts maliciously as an eavesdropper 
to wiretap another legitimate MU. For the considered sce¬ 
nario, we propose three secrecy transmit beamforming (STB) 
schemes in conjunction with two spectrum allocation schemes 
for secure communications in the HetNet, assuming different 
degrees of cooperation among the network nodes. As an initial 
study, we first consider the conventional orthogonal spectrum 
allocation (OSA) strategy na where orthogonal spectrum 
resources are allocated to the MBS and the adjacent FBSs 
to eliminate the cross-tier interference and the interference 
among adjacent femtocells. Employing OSA, the considered 
scenario can be simplified as the secure communication in 
a broadcasting channel, and we consider the STB only per¬ 
formed in macrocell (STB-OM) as a partial solution for the se¬ 
cure communication in HetNet. It is noted that STB-OM aims 
to maximize the secrecy rate of the intended MU subject to 
the Quality of Service (QoS) constraints of the other legitimate 
MUs; no cooperation between the MBS and FBSs is necessary. 
Inspired by the fact that friendly interference can help secure 
communication Go), we deliberately introduce interference in 
the HetNet with the secrecy-oriented non-orthogonal spectrum 
allocation (SONOSA) strategy, which dynamically changes the 
local pattern of the underlay OSA. Specifically, some cooper¬ 
ative FBSs adjacent to the eavesdropper are assigned with the 
same frequency resource as MBS, while the OSA strategy still 
applies to the non-cooperative FBSs. Consequently, CCI is de¬ 
liberately introduced around the eavesdropper to enable more 


effective cooperative STB. Specifically, two STB schemes are 
proposed in conjunction with SONOSA, where MBS performs 
STB in collaboration with its cooperative co-channel FBSs. 
Firstly, a STB scheme is proposed to improve STB-OM with 
a little cross-tier cooperation, which is sequentially performed 
in macrocell and femtocells (STB-SMF). In this scheme, each 
cooperative FBS designs its STB to altruistically maximize 
the generated interference to the eavesdropper while serving its 
own FUs. Then each cooperative FBS calculates a performance 
metric and feeds it back to the MBS to facilitate the STB in 
macrocell, and the MBS can still use the STB-OM with minor 
modification. In order to improve the overall performance of 
STB-SMF, another STB is proposed with the limited cross¬ 
tier cooperation, which is jointly performed in macrocell and 
femtocells (STB-JMF). In this scheme, each cooperative FBS 
feeds its CSI back to the MBS for the joint STB, which aims to 
guarantee the QoS requirements of both MUs and FUs while 
enhancing the secrecy rate of the intended MU. 

For the sake of clarity, the main contributions of this paper 
are summarized as follows: 

1) Upon adopting the OSA strategy, an STB-OM scheme is 
proposed to secure the broadcast channel of the macro¬ 
cell, where the confidential message and the common 
messages are simultaneously transmitted. In particular, 
an iterative algorithm is proposed to maximize the se¬ 
crecy rate while satisfying the QoS of the common mes¬ 
sages. In order to handle the complicated optimization 
problem, we transform the original nonconvex problem 
into a second-order cone program (SOCP) with the aid 
of a first-order Taylor approximation. The approxima¬ 
tion can be improved with each iteration. Therefore, a 
local optimum of the original optimization problem can 
be obtained in several iterations. It is noted that the 
proposed STB-OM is different from the conventional 
STB schemes in the broadcasting channel lf37l . 138) . 
where only the confidential message transmission is 
considered. Furthermore, the STB-OM is applicable to 
the general single cell scenarios and does not need 
cooperation between the MBS and FBSs, which also 
initiates our cooperative STB exploiting CCI. 

2) Based on the SONOSA strategy, a STB-SMF scheme 
is proposed to improve the secrecy rate of STB-OM 
while guaranteeing the QoS requirements of legitimate 
MUs. Different from the traditional jamming sources 
l39l . the cooperative FBSs still serve their FUs while 
helping the MBS. In order to enhance the secrecy rate 
performance of the intended MU, the cooperative FBSs 
selflessly increase the interference power towards the 
eavesdropper without considering the QoS of their FUs, 
and the optimization problem is efficiently solved by 
SOCP. It is worth pointing out that each cooperative FBS 
designs its STB with local CSI, and only a scalar is fed 
back to the MBS for its STB in macrocell, where the 
MBS can still adopt STB-OM. Therefore, the STB-SMF 
scheme imposes very little overhead for the cross-tier 
cooperation, and is compatible with STB-OM. 

3) Employing SONOSA strategy, an STB-JMF scheme is 
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proposed to strike a better balance between the secret- 
rate performance of the intended MUs and the QoS 
requirements of the legitimate MUs and FUs. It is 
noted that such complicated optimization is nonconvex, 
and we opt for reformulating it into a tractable two- 
stage problem. Specifically, we first fix the signal-to- 
interference-plus-noise ratio (SINR) of the eavesdropper 
to formulate the inner stage problem, which can be 
further transformed into a tractable semidefinite program 
(SDP) by applying the semidefinite relaxation technique. 
Then, we perform a one-dimensional search to solve the 
outer stage problem, which finds the most suitable SINR 
of the eavesdropper to optimize the original objective. It 
is noted that the MBS only needs to collect the CSI from 
its cooperative FBSs for this joint STB, and such cross¬ 
tier cooperation imposes acceptable overhead for the 
backhaul. Furthermore, unlike the altruistic STB of the 
cooperative FBSs in STB-SMF, the STB-JMF shceme 
guarantees the QoS of the FUs in the cooperative FBSs. 

The rest of this paper is organized as follows. In Section 
II, the downlink HetNet system model and the corresponding 
spectrum allocation strategies are presented, and we derive 
SINR expressions of various network nodes for the following 
beamforming design. Based on the two spectrum allocation 
strategies, three STB schemes are proposed in Section III, 
where the related optimization problems are formulated and 
solved. In Section IV, simulation results show the effectiveness 
of the proposed algorithms. Finally, conclusions and future 
directions are provided in Section V. 

Notations'. Bold upper and lower case letters denote 
matrices and vectors, respectively. Transpose and conjugate 
transpose are denoted by (*) T and (-) H , respectively, while 
E{-} represents expectation. Tr (•) is the trace operator, || • || 
represents the Euclidean norm, | • | denotes the mode of a 
complex number, and rank (•) stands for the rank of a matrix. 
X >z 0 indicates that X is Hermitian positive semidefinite. 
C represents the field of complex numbers. Re (•) and Im (•) 
denote the real part and the imaginary part of a complex num¬ 
ber, respectively. Additionally, the integer set {1, 2,..., K} is 
abbreviated as [1, K]. CM (/i, cr 2 ) denotes a complex Gaussian 
variable with mean (i and variance a 2 . 

II. System Model 

We consider a downlink HetNet as shown in Fig. 1. There 
is one Nm -antenna MBS at the center, and M single-antenna 
MUs are randomly distributed throughout the macrocell cover¬ 
age area, where we have Nm > M, while the single-antenna 
eavesdropper intends to wiretap the confidential message trans¬ 
mitted to a legitimate MU. Additionally, F Np -antenna FBSs 
are spatially distributed according to a homogeneous Poisson 
point process and each FBS aims to serve K single-antenna 
FUs, where we have Np > K. To simplify the analysis, we 
assume that the transmit power of each FBS is fixed and equal, 
denoted by Pp. Similar to that of the FBSs, the transmit power 
of the MBS is assumed to be Pm- Other relevant variables are 
defined in Table 1. 

Two spectrum allocation strategies are developed in this pa¬ 
per, i.e., the OS A strategy and the SONOSA strategy. Serving 



Fig. 1. Downlink HetNet system model, comprising a macrocell and N 
femtocells. The macrocell consists of a MBS, M legitimate MUs and an 
eavesdropper. Each FBS serves K FUs. 


Table 1 

List of The Major Variables 


Variable 

Definition 

MU m , FBSn 

the m-th MU, the n-th cooperative FBS of 

FU nk 

MBS and the k -th FU of the n-th cooperative 
FBS 

Sm 

the message signal intended for the MU m , 
m G [1, M] , satisfying E{ s m } = 1 

Snk 

the message signal intended for FU n fc, 
n G [1, N], k G [1, K], satisfying 

E{|Kfc||} = l 

h m 

the channel vector from the MBS to MU m 

hn,m 

the channel vector from FBS n to MU m 

\lE 

the channel vector from the MBS to the 
eavesdropper 

h n ,E 

the channel vector from FBS n to the 
eavesdropper 

Fnfc 

the channel vector from the MBS to FU n fc 

^■p,nk 

the channel vector from FBS P to FU n fc> 

p e [l, n] 

W m 

the precoding vector for MU m 

™nk 

the precoding vector for FU nJ t 


as the underlay spectrum allocation strategy, OSA allocates 
orthogonal spectrum resources to the MBS and the adjacent 
FBSs to eliminate the cross-tier interference as well as the 
interference among adjacent femtocells l36l . Building upon 
OSA, SONOSA dynamically changes the local pattern of OSA 
to enable advanced cooperative STB schemes. Specifically, 
the SONOSA strategy assigns the same frequency resource 
occupied by the MBS to the FBSs which are adjacent to the 
eavesdropper, as shown in Fig. 2. Employing SONOSA, the 
co-channel FBSs can work in collaboration with the MBS to 
generate interference to the eavesdropper while serving their 
own FUs. 

Considering SONOSA, we assume that there are N (1 < 
N < F) cooperative FBSs employing CCI to improve the 
secrecy rate of the eavesdropped MU. Let us denote the n-th 
cooperative FBS of the MBS as FBS n and the ra-th MU as 
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Fig. 2. An example for OSA and SONOSA, where the polygons with the 
same color denote the femtocells with the same frequency resource, the apple- 
green triangle is MBS, the cell phone is the eavesdropped MU and the ear 
denotes the eavesdropper. It is noted that OSA is the underlay strategy, and 
SONOSA dynamically changes the local pattern of OSA. Three apple-green 
femtocells are assigned with the same frequency resource as the macrocell to 
generate CCI against the eavesdropper. 


MU m , then the received signal at MU m is given by 

M 

Vm = h m W m S m ^ ^ h m WqS q 

q=l,q^m 

N K 

+ ^ ^ ^ ^ hn,ra ^nk^nk H" ^Tl £ [l, Af] , 

n=lk=1 


where h m £ C 1x7Vm an( j h n?m £ C 1xNf denote the 
channel vector from the MBS to MU m and the channel vector 
from the FBS n to MU m , respectivelyQ w m £ C Nmx1 and 
Sm represent the precoding vector and the message symbol 
intended for MU m , respectively. Similarly, w n /~ £ C Nfx1 
and s n k are the precoding vector and the message signal 
intended for the k -th FU of the n-th cooperative FBS, denoted 
as FU n fc. n m is the Gaussian noise following independent 
and identically distributed (i.i.d.) CM (0,(7^) at MU m . The 
precoding vectors for the MUs satisfy the power constraint of 
EEiIKJ l 2 = p m and the precoding vectors for the FUs in 
a femtocell satisfy the power constraint of Ylk=i ll w n/c|| 2 = 
Pp. Without loss of generality, we assume that there is an 
eavesdropper wiretapping MU J3, therefore the received signal 


l ln this paper, we just assume perfect CSI as our first step to get 
fundamental insights into the physical layer security problem in HetNet. We 
will consider a more practical model including imperfect CSI in our future 
work. 

2 Similar to K3, we focus on the beamforming design in this paper. The 
identification problem - how to identify which MU has been intercepted by 
the eavesdropper - is challenging and important, which will be investigated 
in detail in our future work. In principle, this problem can be solved by 
authentication: the MBS may broadcast some test messages to each MU in 
a round-robin manner, and ask each of them to feed back what has been 
listened. For the wiretapped MU, the MBS will receive feedback from two 
sources. 


at the eavesdropper is given by 

M 

y E =h B wiSi + ^ h B w m s m 

m= 2 r 2 ) 

N K y ’ 

+ EE hn,FW n fcS n fe + Up , 

n—1k=l 

where hp £ C 1xNm denotes the channel vector from the MBS 
to the eavesdropper, h n ,p £ C 1xNf is the channel vector 
from FBS n to the eavesdropper, and np is the Gaussian noise 
obeying i.i.d. CM (0 at the eavesdropper. Furthermore, 
the received signal at FU n /~ can be formulated as 

K 

link = ^-n,nk^nk^nk H" E nt 

t=l,tj^k 

N K M 

+ E E hp,n/c T ^ ] h n fcW m S m ~\~ 7 'Ink: 

p=l,p^n t= 1 m=l 

(3) 

where h. n ,nk £ C 1xNf is the channel vector from FBS n to 
FU n /c, h n k £ C 1xNm is the channel vector form MBS n 
to FU*;, and the Gaussian noise n n k at FU n /~ follows i.i.d. 
CM (0 ,a 2 p). 

To facilitate the analysis of secrecy rate performance, we 
define the SINR of MU m as 


SINR m = 


|h m w m | 2 
A-rn 


,m £ [1, M ], 


(4) 


where 

M N K 

A m = yy ih m w 9 i 2 + y^y^|h n , m w nfc | 2 +<Ti,. 

q=l,q^m n= 1 k =1 

Similarly, the SINR of the eavesdropper is represented as 


SINR £ = 


|hgwi|" 

Be 


(5) 


where 


M N K 

Be = X] |h£;w m | 2 + E l h n,E^nk \ 2 +&Ei 

m =2 n= 1 k= 1 

v -v-' 

IFT sum 


and IFT snm is the sum of the additional interference tem¬ 
perature from all the cooperative FBSs to the eavesdropper. 
Finally, the SINR of the FU n /c is written as 

SINR ra fc = |hw ’^ Wrafc| ,ne[l,N],ke[l,K\, (6) 

G nk 

where 


K N K 

C^nk — ^ |h n?n /c"W n ^| ~\~ E E | ^-p,nk Wpt | 

t=l,t^k p=l,p^n t=l 

M 

+ yy |h rafc w m | 2 + a 2 F . 

m= 1 

After the above preliminary derivations, we will propose 
three STB schemes in the next section to maximize the secrecy 
rate of the intended MUi. 
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(jj) Eavesdropped MU 


t 

O 

0 


Eavesdropper 


Legitimate MU 


Fig. 3. An example channel model for the STB-OM scheme, consisting of 
one MBS, M = 2 MUs and one eavesdropper wiretaps the first MU. As the 
OSA is employed, the system is equivalent to a broadcast system. The solid 
lines indicate useful data streams, and the dash line indicates the interference 
stream. 


III. Security Transmit Beamforming Schemes for 
HetNet 

In this section, we propose three secrecy communication 
schemes to improve the secrecy rate of HetNet by jointly 
considering the spectrum allocation strategy and the transmit 
beamforming. Firstly, based on the OSA strategy, we propose 
the STB-OM scheme as a partial solution for secure commu¬ 
nication in HetNet. Then, we employ the SONOSA strategy to 
propose the STB-SMF scheme, which improves STB-OM with 
secrecy-oriented CCI generated by the altruistic cooperative 
FBSs. At last, aiming at a balanced system performance, we 
propose the STB-JMF scheme, which optimizes the security- 
rate of the intended MU while satisfying the QoS constraints 
of both legitimate MUs and FUs. In the remaining part of 
this section, we will discuss each STB scheme in detail. Note 
that in all the three proposed schemes, we assume that the 
local CSI of the MUs and of the eavesdropper is available 
at the MBsH, and each FBS knows the local CSI of its own 
femtocell. 


A. Secrecy Transmit Beamforming Only Performed in Macro¬ 
cell (STB-OM) 

Let us first discuss the STB-OM scheme that relies on 
the OSA strategy. Because different frequency resources are 
allocated to the MBS and FBSs, no CCI exists in this scheme. 
As shown in Fig. 3, the MBS serves multiple legitimate MUs, 
and we assume that MUi is wiretapped by the eavesdropper. 
Our goal is to maximize the secrecy rate of MUi while 
guaranteeing the QoS, i.e., SINR, requirements of other le¬ 
gitimate MUs. The proposed STB-OM scheme is aiming at 
the secrecy rate maximization. Unfortunately, this optimization 
problem, formulated as (7a) to (7c), is non-convex and hence 
prohibitive computational complexity may be incurred for 
finding its optimum solution. As a compromise, we employ a 
low-complexity iterative algorithm ED which conservatively 
approximates the original problem as several tractable SOCP 
subproblems. In the remaining part of this subsection, the 
details of the problem formulation and solution are provided. 

3 Similar to m GE ED, and (37), we assume that the CSI of the 
eavesdropper is also available at the MBS in order to make the STB more 
tractable. 


Initially, the secrecy rate optimization problem of STB-OM 
can be formulated as 


max 

(w m }% =1 

s.t. 


log(l + SINRi) - log(l + SINR*;) (7a) 


SINR m > Jm, m e [2, M ], 


Em=l 


|w m || < P M , 


(7b) 

(7c) 


where the received SINRs from © and (0), that are associated 
with MU m and the eavesdropper, can be simplified as 

I "h... w— 1^ 

SINR m = 


J M 


+ E£l. 


12 ’ 


q^m I 


and 


SINRs = 


|hswi|" 


Z-^m =2 


|hsw TO | + IFT 

S 


( 8 ) 


(9) 


U E ^ Z^ m =2 I 

respectively, when the OSA strategy is adopted. Note that 
the IFT snm in this STB-OM is zero, because OSA does not 
introduce CCI. The constraint (1751) is the QoS requirements 
of the other legitimate MUs, i.e., MU m ,m G [2, M], and (I7cl) 
represents the total transmit power constraint at the MBS. To 
make the above problem more tractable, we introduce a pair 
of slack variables t\ and t 2 . Then, the original problem can 
be equivalently reformulated as 


max log(ti) + log(t 2 ) (10a) 

s.t. 1 + SINRi >t u (10b) 

1 + SINR*; < l/t 2 , (10c) 

SINR m > 7 m , m G [2, M] , (lOd) 

M 

ii w ™ii 2 - Pm - ( i0e ) 

m=l 


Without loss of generality, in the following, we assume g 2 m — 
= dp = a 2 = 1. Substituting ® and © into the above 
problem, di can be transformed as follows 


max 


S.t. 


tlt 2 


M 


1 + J2 W m H l W m < 


m= 2 
M 


wf HiWi 
*i-l ’ 


1 + w m H S w m 


m=l 


i + EL W^H*;W m 


< 


t 2 

M 


7m I 1 + HmW « 

\ q=l,q^m 

< w mH m w m , m e [2, M ], 

M 

11 w m 11 2 < Pm, 

m= 1 


(11a) 

(Hb) 


(11c) 


(Hd) 

(He) 


where we introduce the matrices Hi = h| h^, H m = h m h^, 
H e = h^h^. It is noted the logarithm function is removed 
because of its monotonically increasing property. As we can 
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see, the right-hand side of the constraints (lllbl) and (lllcl) 
are both quadratic-over-linear functions which are convex 
ll42l . However, both constraints remain non-convex because 
they are expressed as the form of fi{x) < ^(x), namely 
fi{x) — f 2 (x) < 0, where f\(x) and f 2 (x) are both convex 
functions. More specifically, it is well known that the sum of 
convex functions is convex. Then, fi(x)—f 2 (x) is non-convex. 
Following the idea of the constrained convex procedure fiD . 
we replace these quadratic-over-linear functions with their 
corresponding first-order expansions, and then the problem can 
be transformed into a convex one. Specifically, we define 


F A ,a( w,x) 


w 77 Aw 

x — a 


( 12 ) 


where x > a, A y 0. The first-order Taylor expansion of (fl2l) 
at a certain point (w, x) is given by 


QaA vr,x,vr,x) 


2Re{w^Aw} 

x — a 


w 77 Aw 

(x — a) 2 


(x-a). (13) 


Furthermore, it is noted that max tit 2 can transformed into 
a SOCP representation, e.g., max £ 0 with an additional con¬ 
straint || [2t 0 (ti — ^ 2 )] || < t\ + £ 2 * This transformation is 
based on the fact that the constraint £^2 > £0 is equivalent 
to || [2£ 0 (£1 —£2)] || < £1 + £2, where we have £1 > 0 and 
£2 > 0. Based on the above preparations, for the point (w, x), 
the problem ClD can then be transformed into a convex 
optimization problem as follows 


max £0 (14a) 

M 

S.t. 1 + w m H l w m 

m =2 

(14b) 

M 

1 + 53 w m H £ w m 

m=1 


2 t M 

< Y ~ r| + 53 < 3H E ,o(w m ,t 2 , 
t2 *2 m= 2 

Vfm,t 2 ), 


(14c) 

/ M \ 


7m 1 + 53 w f H mW ? 


\ q=l,q^m ) 


< w^H m w m , TO e [2, M] , 

(14d) 

M 


53 ll w m|| 2 < Pm, 

(14e) 

m= 1 


|| [2*0 (ti - t 2 )] 1 <ti+1 2 . 

(14f) 


Eventually, the problem can be converted to the following 
SOCP form (IT5l) where the linear functions gi,g 2 ,g 3 m are 
respectively defined as 

Qi = Qh 1} i(wi,£i, wi,£i) - 1, (16) 

M 

g 2 = ^2 QH E) o(w m , £2, Wm, £2) - £2/^ - 1, (17) 

m=2 

53m = Re (w^h m ) /VtwT, to € [2, M]. (18) 


It is noted the SOCP ([T5l ) can be solved efficiently by using 
the available solvers such as CVX ll43l . The proposed STB-OM 
scheme is summarized by Algorithm 1 as follows. 


Algorithm 1 STB-OM 

1) Initialization: Set w m , t\ and £2 as the values which are 
feasible to the problem (IT5] ) . 

2) Repeat: 

Solve the SOCP problem (fl~5l) with (w m ,£i,£ 2 ) and 
obtain the optimal values (w^,^,^). 

Update (w m ,ti,t 2 ) = 

3) Until the convergence threshold is satisfied or the max¬ 
imize number of iterations is reached. 

4) Output w m . 


The original optimization problem of STB-OM is non- 
convex and NP-hard, thus its global optimum cannot be 
obtained with polynomial computational complexity using any 
known algorithm. By contrast, the proposed scheme, which 
is described by Algorithm 1, employs the first order Taylor 
approximations to transform the original optimization problem 
into a convex optimization problem. The globally optimal 
solution of the resultant convex optimization problem can be 
obtained upon using Algorithm 1, which, according to HU . 
can be proved to converge to a local optimum of the original 
optimization problem in a few stepfl 

Remark 1. Since the optimization problem defined in (fl5l) 
is convex, the optimal solutions {w^}^f =1 , £q, £*, ££, are 
obtained by solving (IT3T) for a given (w m ,£i,£ 2 ). At each 
iteration, (w m ,£i,£ 2 ) is updated based on the optimal solu¬ 
tion (w^f*,^) obtained in the previous iteration. Hence, 
(w m ,£i,£ 2 ) is always a feasible solution of the current iter¬ 
ation, and the value of £0 obtained for the given (w m ,£i,£ 2 ) 
will be larger than or equal to the value of £0 of the previous 
iteration. This observation reveals that the required secrecy rate 
will be monotonically increasing (or at least nondecreasing) at 
each iteration, which is demonstrated by the numerical results 
in Fig. SI Due to the power constraint, there is an upper bound 
for the achievable secrecy rate. Therefore, the convergence of 
the proposed Algorithm 1 can be guaranteed. 


Remark 2. It is clear that for the STB-OM, only the local CSI 
is required at the MBS, including the CSI of MUs and the 
CSI of the eavesdropper. 

Remark 3. If an FU in a femtocell is wiretapped by another 
FU in the same femtocell, the problem is mathematically 
identical to that we have solved in this subsection. In other 
words, the proposed approach is applicable to general single¬ 
cell interference-free scenarios. 









7 


max 

{w m }^ = 1 ,t 0 ,ti,t 2 

S.t. 


^0 

[2wfhi,...,2w^hi,0i - l] T <5i + l, 

[2wfh B ,...,2w^h B ,5 2 - l] T <52 + 1, 

[2wf h m ,..., 2w^_ 1 h m , 2w^ +1 h m ,2w^h m , 2,5 3m - l]' 
Im(w^h m ) = 0, m e [2, M], 

[wf,...,w^] T <-/Pm , 

II [2t 0 , (ii - i2)]|| < h +h, 


< 9 3m + 1? 


(15a) 

(15b) 

(15c) 

(15d) 

(15e) 

(15f) 

(15g) 




Legitimate FU 


Eavesdropped MU 


Eavesdropper 


Legitimate MU 


Legitimate FU 


Fig. 4. The convergence property of Algorithm 1 under different values of 
the transmit power of the MBS. 


B. Secrecy Transmit Beamforming Sequentially Performed in 
Macrocell and Femtocell (STB-SMF) 

Compared to the conventional transmit beamforming with¬ 
out the consideration of secrecy, the secrecy rate performance 
of MUi can be improved by the STB-OM for its clear 
objective. In fact, we may further improve the secrecy rate 
performance by designing more sophisticated approaches. As 
shown in t44) . it is potentially feasible to exploit interference 
for improving the secrecy rate performance. In order to achieve 
this goal, judicious interference management schemes could 
be developed. To justify these assumptions, a secrecy-oriented 
spectrum allocation strategy, i.e., the proposed SONOSA, is in¬ 
voked to introduce deliberate CCI that is friendly with respect 
to the secrecy rate performance of MUi. The SONOSA strat¬ 
egy dynamically changes the local pattern of the underlay OS A 
to improve the performance of STB-OM. Based on SONOSA, 
the cooperative co-channel FBSs can act independently as 
the sources of friendly CCI to degrade the performance of 
the eavesdropper. Specifically, the cooperative FBSs selflessly 

4 The performance gap between Algorithm 1 and the optimal scheme cannot 
be provided at this stage due to the difficulty of obtaining the global optimum 
of the original optimization problem. Nevertheless, when proper initial values 
are given (although this is challenging as well), the local optimum achieved 
by Algorithm 1 may be equal to the global optimum of the original problem. 


Fig. 5. An example channel model for STB-SMF scheme, consisting of 
one MBS, M = 2 MUs, N = 2 cooperative FBSs, and K — 1 FU at 
each femtocell. An eavesdropper wiretaps the first MU in the macrocell. As 
the SONOSA is adopted, the channel model is equivalent to an interference 
channel model. The black solid lines indicate useful data streams, and the 
black dash lines indicate interference streams, which are optimized by STB- 
SMF. In particular, the blue dotted lines indicate the feedback of interference 
temperatures from FBSs to the MBS. 


maximize the power of leakage interference imposed on the 
eavesdropper to improve the secrecy rate performance of 
MUi. By exploiting the null space beamforming technique 
at the cooperative FBSs, the interference would only affect 
the eavesdropper’s received signal. 

Here, as shown in Fig. 4, we develop a novel STB-SMF 
scheme to exploit the interference in HetNet with SONOSA. 
In what follows, we first discuss the STB design for the n- 
th cooperative FBS FBS n , n G [1,7V]. We consider that 
FBS n transmits data streams in the null space of G n = 
[hj : h^ 2 ,..., h^ M ] T G C MxNf , which is the collective 
channels from FBS n to all legitimate MUs. To guarantee the 
existence of the null space, Nm > Np > M has to be 
satisfied. As a consequence, the interference from FBS n would 
only degrade the eavesdropper’s channel. In order to improve 
the secrecy rate, we aim at maximizing the interference from 
FBS n to the eavesdropper subject to the transmit power 
constraint. The problem can be then formulated as follows 





































max Tr [W^H n ,£;W n ] (19a) 

w n 

s.t. Tr[W*W„]<P F , (19b) 

G„W„ = 0, (19c) 

where H„ >F = h^ E h„ :E , W n = [w n ,i, w n , 2 , ... , w„ jF: ], 

and G n W n = 0 ensures that FBS n does not generate 
interference to the legitimate MUs. In order to eliminate 
the inter-cell inter-user interference of the K FUs served 
by FBS n , the beamforming vectors of FBS n should also 
satisfy k h n ^ nt = 0, k,t G [1,A], k / t. Let us define 
w n ,k = V n x n)i t, where the columns of V n constitute an 
orthogonal basis for the null space of G n . The optimization 
problem (IT9b is then equivalent to 


K 


max S'] x^ fc Ri„x„ ilt 

| x n,fc}fc —i k = l 

(20a) 

K 


S.t. y2 X n,kR-2n*n,k < Pf, 

(20b) 


k =1 


x n,kVn h n,nt = 0 ,k,t€ [1 , K], k ± t, (20c) 

where we have Ri„ = V^H n , F V ra , and R 2 „ = V^V n . 
The above problem can be further transformed into a SOCP 
problem by introducing a slack variable a as follows 


max a 

{Xn,fc}f = i,a 


(21a) 


s.t. 


[hn,^"V n X n? i, • • . , h n ^;V n X n 


< ck, 

(21b) 

[V ra x ra) i,...,V n x ra)F ] T <\/Pf , (21c) 

x ^ V n h n,nt = 0, k ± t , k, t G [l,iF]. 

(2 Id) 


As we can see, the problem (l2Tb is a standard SOCP problem 
and can be solved efficiently via some numerical solvers, such 
as CVX 03. For some special case, we can even obtain the 
closed-form solution. For example, when the number of FU 
served by FBS n is 1, i.e., K = 1, the problem (f20b can be 
simplified as 

max x^RinXn,! (22) 

X n , 1 

s.t. x^ 1 R 2 „x„ i i < P F . 

The optimal solution of (l22l) is given by x* x = 
^4^max (I^inj where (j)max (-f^in •> -f^ 2 n) denotes the gen¬ 

eralized eigenvector corresponding to the largest general¬ 
ized eigenvalue of the matrix pair (Ri n ,R 2 n ) and a = 

. The optimal value of 
the objective function (1221) is PpA ma ^(Rin, R2n)> where 
^maxi^lim R 271 ) is the largest generalized eigenvalue of ma¬ 
trix pair (Ri n ,R 2 n). As a result, the optimal beamforming 
vector can be expressed as w* 1 = V n x* 

After designing the STB at the cooperative FBSs, we 
continue to design the STB at the MBS. It is noted that based 
on the interference temperature generated by the cooperative 




R 




(f^ln: -f^2n) 


FBSs (cf. ©), we can obtain the STB of the MBS by 
employing the STB-OM with minor modification. Specifically, 
let us define the interference temperature generated by FBS n 
at the eavesdropper as 

K 

lFT n = Y / KE<,k \ 2 , ( 23 ) 

k = 1 

then the sum of such interference from all N cooperative FBSs 
is IFT sum = J2n= 1 IFT n- 11 should be noted that IFT, um 
is calculated by the MBS, after receiving the feedback about 
IFT n from FBS n . Then the MBS performs STB according to 
STB-OM and IFT sum . For clarity, the proposed STB-SMF is 
summarized by Algorithm 2 as follows. 


Algorithm 2 STB-SMF 

1) Obtain the beamforming vector w* k of FBS n with (PTl) 
or (l22l) . 

2) Each cooperative FBS n calculates IFT n (l23t and trans¬ 
mit it to the MBS. 

3) The MBS calculates IFT snm = J2n=i and ob¬ 
tains the beamforming vector of the MBS according to 
the STB-OM in Algorithm 1. 


Remark 4. It is worth mentioning that each cooperative FBS 
only needs to send a scalar IFT swm to the MBS in this scheme. 
Hence, STB-SMF only incurs a small increase of the backhaul 
traffic loads. Furthermore, only the local CSI is required at 
each FBS. In contrast, the local CSI and the interference 
temperature are required at the MBS. 

Remark 5. In the STB-SMF, we take the QoS constraints of 
MUs into consideration while the QoS of FUs is ignored. 
In other words, we do not intend to ensure or enhance the 
QoS of FUs. Transmit beamforming vectors are designed 
for the cooperative FBSs to improve the secrecy rate of 
the eavesdropped MU, and no interference is generated to 
the other MUs. The STB-SMF is an altruistic manner from 
the view point of the FBSs. A more practical scheme is 
developed in the next subsection, where the QoS of FUs is 
considered. Despite this fact, the STB-SMF proposed in this 
subsection serves as a preliminary scheme which provides 
us the first insight into the interference-aided physical layer 
security enhancement in HetNet. Furthermore, the STB-SMF 
scheme also acts as a design alternative for achieving the 
tradeoff between the performance and the implementation 
complexity. Compared to the practical scheme proposed in the 
next subsection, less cooperation and computation are required 
by the STB-SMF. 

C. Secrecy Transmit Beamforming Jointly Performed in 
Macrocell and Femtocell (STB-JMF) 

In the STB-SMF scheme, CCI is deliberately introduced 
and exploited. The secrecy rate performance of MUi is thus 
enhanced, and the QoS of the other MUs is also guaranteed. 
Nevertheless, the QoS of the co-channel FUs is ignored, which 
implies that we cannot ensure the sum-rate performance of the 
FUs of the cooperative FBSs. 
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Legitimate FU 


Eavesdropped MU 


Eavesdropper 


Legitimate MU 


Legitimate FU 


Fig. 6. An example channel model for STB-JMF scheme, consisting of 
one MBS, M = 2 MUs, N = 2 FBSs, and K = 1 FU at each femtocell. 
An eavesdropper wiretaps the first MU in the macrocell. As the SONOSA 
strategy is used, the channel model is equivalent to an interference channel 
model. The solid lines indicate useful data streams, and the dash lines indicate 
the interference streams. The blue glow dotted lines indicate the CSI streams 
delivered from FBSs to the MBS. The red dash-dot lines denote the STB 
vectors delivered from the MBS to the FBSs. 


In this section, we propose a joint secrecy transmit beam¬ 
forming scheme named STB-JMF to improve the secrecy rate 
of MUi while ensuring the QoS of the other MUs and FUs. 
Note that the SONOSA is also used in the STB-JMF scheme 
in order to take advantage of the CCI from the point of secrecy. 
Our goal is to maximize the secrecy rate of MUi subject 
to the MBS/FBSs transmit power constraints and the SINR 
requirements at the other MUs and FUs. The transmit beam¬ 
forming vectors of both the MBS and the cooperative FBSs 
are optimized jointly. To be more specific, each cooperative 
FBS obtains its local CSI and then sends it to the MBS. As 
a result, global CSI becomes available at the MBS. Then, the 
MBS jointly optimizes the beamforming vectors with the aid 
of the global CSI. 

Following the analysis in the previous sections, we can 
formulate the original optimization problem as 

max log 2 (l + SINRi) — log 2 (l + SINR#) 

{w m}™ =1 , 

({W nk }Ll}n = l 

(24a) 

M 

S.t. £||w m || 2 <P M , 

m= 1 
K 

||w n fc || 2 < Pf,ti G [ 1 , V], (24b) 

k=1 

SINR m > 7 m ,rne[ 2 ,M], (24c) 

SINR n/c > 7 nk ,n e[l,N],ke [1, K ], 

(24d) 

where (124bl) characterizes the total transmit power constraints 
at the MBS and the cooperative FBSs, (I24cl) is the QoS 
requirement of intact user m in the macrocell, and (124dl) is the 
QoS requirement of FU^. As we can see, the optimization 
problem is non-convex and hence is very hard to solve. Despite 
the challenge, in what follows we will show that the problem 


can be solved globally optimally by reformulating it as a two- 
part problem. Let W m = w m w^, W nk = w n/c w^, we 
can use semidefinite relaxation technique l45l to simplify the 
problem. First, we introduce a slack variable r = SINR#, and 
(f24l) can be equivalently transformed into 


max 

{W 

({WndLllLl 

S.t. 


1 + T 


1 + 


Tr(HiWi) 


A 

X TV(W m ) < P M , 


M 


m =1 
K 

yy Tr(W ra fc) < P F , n G [1, N ], 
k =1 

TY(H m W m ) 


An 

Tr(H ni „fcW ra fc) 


^ 'ym, G [2, 7U] , 


CL 


^ 'Jnk, 


nk 


ne[l,N],ke[l,K\, 
Tr(H B W!) 


B' 


< r, 


(25a) 

(25b) 

(25c) 

(25d) 

(25e) 
(25 f) 


where A lt A rn , B and C nk are respectively defined as 


M N K 

A[ = X Tr(H m W m ) + X X Tr(H nA W nk ) + 1, (26) 

m> 2 n= 1 k=l 

M N K 

X m = X Tr ( H mW 9 ) + X X Tr(H n , m W nfc ) + 1, 

q=l,qy^m n=1 k= 1 

(27) 

M N K 

B = X Tr(H £ W m ) + X X Tr ( H «.® W ^) + L ^ 28 ) 

m> 2 n= 1 k= 1 

K N K 

^nk X ,nfc"W nt) T X X Ti '( H p,nk^^pt) 

t=l,t^k p=l,p^n t=1 

M 

+ X Tr(H nfe W m ) + 1, (29) 

m =1 

= h n;m h n rn , H n? # = h n? #Ii n #, H n ^ nk = 

hn,nfch^ n ^, H p^nk = \lp^ nk \l^ n j^ and H rik — ^-nk^-nk' 

To solve the problem (l25l) . we divided it into two parts. 
The outer part is a one-dimensional line search problem with 
r, i.e., 


max 

r 


S.t. 


1 + G(t) 

1 + T 

0 < T < Tr(H!)P M . 


(30) 


The function G(r) is defined by another optimization problem 
to be described later. The lower bound about r can be obtained 
directly from (125fl) . while the upper bound is derived from the 
fact that the secrecy rate is greater than or equal to zero, hence 
r < Tr(Hi )Pm- For a fixed r, the inner part can be expressed 
as 


max 

s.t. 


TrCHiWi) 

A 

d25bl) - d25fl). 


(31) 
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Algorithm 3 STB-JMF 

1) Initialization: Set Pm , Pf, 7 ™, 7 n /c> £ (the search 
precision of the Golden Section Search); 

2) Compute r ma;r = Tr(Hi)P M ; 

3) Solve (l30t by applying one-dimensional line search 
method, e.g., the Golden Section Search, on interval 
[ 1 , Tmax ], obtaining the optimal r*. To do this, we have 
to solve (l32l) to obtain G* (r) for a fixed r. 

4) Obtain (X^,X; fc ,C*) for r*. 

5) LetW^ = f-,W; fc = ^. 

6) If rank(W^) = rank(W* /c ) = 1, we can obtain 
and w* fc via eigenvalue decomposition; 

7) Otherwise we apply Gaussian randomization method to 

and W* fc for finding approximate and w*^. 

8) End 


and G(r) is equal to the optimal value of ([3Tb . 

It is observed that the problem (l30l) is equivalent to the 
original problem (l25l) . For any fixed r, we can obtain G(r) by 
solving ([371 ) . Then, applying the one-dimensional line search 
method, e.g. Golden Section Search, to the interval [1,1 + 
Tr(Hi)P m]» we can solve the problem (l25l) . Hence, the key 
step is to solve (EB for a fixed r. In what follows, we will 
concentrate on it. 

Since, the objective function of ([7Tb is a linear fractional 
function and thus it is quasi-convex 1461 . then we can use 
Charnes-Cooper transformation ll47l to convert it into a linear 
one. Upon introducing the auxiliary variables X m ,X n /~ + 0, 
C > 0, we can rewrite W m and W n /c as W m = 

W nk = then the problem (OTI) can be transformed 

into the problem (l32l) . 

It can be seen that the problem (l32l) is an SDP problem lf45i 
which can be solved efficiently by using numerical solvers 
such as CVX l43l . The optimal solution of the problem (l32b is 
denoted by (X^, X*^, £*). Hence the corresponding optimal 
solution of the problem ([3Tb can be obtained as 

W*/, = Then, we can solve the problem (l30b through the 
one-dimensional line search method such as Golden Section 
Search. Note that to get the finial solution, we need to solve 
a sequence of SDPs. 

Let us denote the optimal solution of the problem (l30b as 
(W m ,W n fc). Then, we can obtain the beamforming vector 
solution as follows: if rank(W m ) = 1, the optimal beam¬ 
forming vector w m is exactly obtained via eigenvalue decom¬ 
position; otherwise some rank-one approximation procedures, 
e.g. Gaussian randomization ll48l can be applied to W m for 
obtaining w m . The same procedure is applicable to W n £. For 
the sake of clarity, the proposed STB-JMF is summarized in 
Algorithm 3. 

Proposition 1. The optimal solution {X m }^f =1 , 
{{X n k}k=i}n=i °f Problem (l32b is always rank-one. 

Proof: Please see Appendix. ■ 

Proposition 1 shows that using semidefinite relaxation is 
always tight and yields a rank-one solution for the STB-JMF. 

Remark 6. In the STB-JMF, not only the QoS of MUs but 


also the QoS of FUs are taken into consideration. In other 
words, we can guarantee the QoS of all the legitimate users 
in both the macrocell and the cooperative femtocells. This 
is pragmatically attractive because QoS is one of the most 
important performance metrics for practical HetNet. 

Remark 7. The STB-JMF scheme is capable of satisfying 
the QoS requirements as well as enhancing the secrecy rate 
performance of the eavesdropped MU, which is in contrast 
to the sole beamforming in STB-OM and the sequential 
beamforming in STB-SMF. The cooperative FBSs need to 
share their local CSI with the MBS. The CSI of all the 
MUs and FUs are available at the MBS, so that the transmit 
beamforming vectors for the MBS and FBSs are all designed 
at the MBS. Then, the MBS delivers the related beamforming 
matrices to the cooperative FBSs. 

Remark 8. The proposed three STB schemes exploit the coop¬ 
eration among network nodes in varying degrees. In the STB- 
OM scheme, no cooperation is used. In STB-SMF, each coop¬ 
erative FBS designs transmit beamforming vectors separately 
for the sake of enhancing the secrecy rate performance of the 
eavesdropped MU. A scalar needs to be fed back to the MBS 
from each cooperative FBS to assist the secrecy beamforming 
at the MBS. In STB-JMF, all the cooperative FBSs have to 
share the CSI with the MBS, and the transmit beamforming 
vectors for the MBS and FBSs are jointly designed at the 
MBS to satisfy universal QoS requirements, which cannot be 
supported by the STB-OM and STB-SMF schemes. Moreover, 
it is worth pointing out that no data sharing is required for any 
of the proposed STB schemes, which ensures low traffic load 
on the backhaul links. 

Remark 9. Based on S3, we derive the computational com¬ 
plexity of the proposed algorithms as follows. Firstly, the 
computational complexity of Algorithm 1 is Ti-0(NmM 3 - 5 + 
N^M 2 - 5 ) • log 2 (“). Since Algorithm 2 is based on Algorithm 
1 and the only difference is that Algorithm 2 has to first 
calculate the interference caused by each FBS, the computa¬ 
tional complexity of Algorithm 2 is then characterized by (N • 
0(N%K + N f K 2 ) + Ti ■ 0 (N m M 3 - 5 + N 3 m M 2 - 5 )) • log 2 (|). 
Finally, Algorithm 3 is based on SDP and one-dimensional line 
search, and its computational complexity is Ts-O^NK 
Np- 5 )+N 2 K 2 (N 2 J> +N 2 p)+ N 3 K 3 (N^ 5 +NP))- log 2 (\), 
where e denotes the accuracy requirement, Tj is the number 
of iterations required in Algorithm 1 and 2, and T$ is the 
number of searches carried out in Algorithm 3. As we can 
see, the computational complexity of Algorithm 3 is higher 
than that of Algorithm 1 and 2. 

Remark 10. It is easy to extend the proposed schemes to 
the scenario where there are multiple eavesdroppers. The 
only difference is that the resultant optimization problem has 
to consider the SINR constraints of multiple eavesdroppers. 
Then, we can use the proposed algorithms to solve them. 
For the scenario where multiple legitimate MUs are targeted 
by the eavesdroppers, we may maximize either the secrecy 
sum-rate of the network or the minimum secrecy rate of the 
legitimate MUs, and the process of solving them is similar to 
the proposed algorithms. 
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max Tr(HiX!) 

(x m }“ =1 ,c 


{{x„ fc }r=i}^=i 

s.t. 


M 


Tr(X m ) < PmC, 

m =1 
K 

^TV(X nfe ) <PfC, 

k =1 

M 

Tr(H m X m ) > 7m ( ^ Tr(H m X g ) + E E TV(H n , m X nfc ) + C), 


N K 


(32a) 

(32b) 

(32c) 

(32d) 


9=1, 

q^m 


n =1 /c—1 


AT 


TV K 


M 


Tr(H n , n ,X n ,) > 7 n/c( Tr(H n5n /cX nt ) + Tr(H P;n feX p t) + Tr(H n /eX m ) + £), (32e) 


t=i, 

t^k 


p= 1 t=l 
p/n 


m=l 


M 


AT K 


^(HfiXi) < r( ]T T¥(H £ X m ) + E E Tr(H n ,£:X nfc ) + C), 


m =2 


n=l /c=l 


M 


AT K 


X) Tr ( H A™) + E E Tr(H n , m X nfe ) + C = 1, 

m =2 n=l /c=l 

X m , X n /c E o, c > 0. 


(32f) 

(32g) 

(32h) 


IV. Simulation Results and Discussions 

In this section, simulation results are provided to evaluate 
the secrecy rate of MUi for different transmit beamforming 
schemes conceived. We consider a downlink HetNet with a 
central MBS serving a circular region C and the area of C is 
denoted as C. We suppose the radius of C is 500m. The FBSs 
are spatially distributed according to a Poisson point process 
iff with intensity A/ lt50l . Therefore, the average number of 
FBSs within the cellular coverage is given by Nfbs = A/C. 
Femtocells are derived from the Voronoi tessellation and we 
can attain the stochastic geometry model ll36l for the cellular 
systems illustrated in Fig. 2. The simplified system models 
of the three proposed STB schemes have been illustrated by 
Fig. 3, Fig. 4 and Fig. 5, respectively. In all simulations, the 
antenna configurations of the MBS and the FBS are Nm = 10 
and Np = 4, respectively. The number of MUs is M = 2, and 
the number of FUs in each FBS is K = 1. We also assume all 
MUs, FUs and the eavesdropper are single-antenna nodes due 
to practical constraint. For STB-SMF and STB-JMF schemes, 
we assume there are two cooperative FBSs helping improve 
the secrecy rateH, and each cooperative FBS serves one FU. 
According to the ITU-R channel simulation specifications ED, 
we assume that the MBS has larger transmit power than 
the FBSs and the specific numerical values are given in the 
following. Moreover, the channel is modeled as a Rayleigh 
fading channel in all the simulations. 

5 Our numerical results, which are not provided here due to page limitations, 
show that two cooperative FBSs are enough for achieving good secrecy 
performance. This is because when the number of cooperative FBSs increases, 
the interference imposed on the wiretapped MU also increases, hence the 
secrecy performance may not see any notable improvement. 


A. Benchmark Scheme 

The benchmark scheme is designed as follows. First, we 
aim to maximize the rate of the wiretapped MU, i.e., MUi, 
without the consideration of secrecy, and obtain the non¬ 
secrecy-oriented beamforming vectors for the legitimate MUs 
and the FUs within the cooperative femtocells. Then, we derive 
the secrecy rate of MUi with the non-secrecy-oriented beam¬ 
forming vectors, which serves as our benchmark scheme. To 
be more specific, this optimization problem can be expressed 
as 

max logofl + SINRi) (33a) 

{Wm}" =1 , 

M 

s.t. e - Pm ' 

m= 1 
K 

Ell w "*ll<ft’,«e[ 1 ,JV], (33b) 

k=1 

SINR m > 7 m , m G [2, M \, (33c) 

SINR n/c > 7 n /c,n G [l,N],k G [1 ,K\, (33d) 

where (I33bb characterizes the transmit power constraint at the 
MBS and FBSs, while (I33cb and (133db represent the QoS 
requirements of the legitimate MUs and the FUs, respectively. 
Note that this nonconvex problem can be transformed into 
an SDP problem, which is convex, by dropping a rank-one 
constraint that emerges in the transformation process and has 
the form of rank(X) = 1. For more details, please refer 
to the process of transforming the problem (OTT) into the 
problem (l32b . Upon finishing the optimization, we can obtain 
the secrecy rate of MU i. This scheme has been considered by 
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Fig. 7. The secrecy rate of MUi versus the transmit power of the MBS. 
In the STB-SMF and STB-JMF schemes, two FBSs are used to generate 
interference. 

ea, m. 

B. Performance of the Proposed Schemes 

Fig. [7] shows the comparison results regarding MUi’s se¬ 
crecy rate performances with different schemes for Pp = 
40dB. Because the wiretapped MUi receives more power but 
the received noise power does not rise when the transmit power 
of the MBS increases, so we can observe that the secrecy 
rate performance of all the four schemes grow as the transmit 
power of MBS increases. It is also shown that the secrecy rates 
of the proposed three STB schemes always increase faster than 
the benchmark scheme, especially when the transmit power 
of the MBS is high (e.g., 42dBm and 45dBm). Obviously, 
the secrecy rate performance of STB-JMF and STB-SMF is 
better than that of STB-OM. This observation verifies that the 
deliberately introduced interference is capable of enhancing 
enhance the secrecy rate performance of the eavesdropped 
MU. Furthermore, it is worth noting that R s of STB-SMF 
slightly outperforms STB-JMF at all the transmit power values 
of the MBS, since STB-SMF does not consider the QoS of 
FUs. 

Fig. [8] illustrates the secrecy rate of MUi for the STB-SMF 
and STB-JMF schemes under various FBS transmit power 
values. It is shown that in all schemes the secrecy rate of 
MUi improves as we increase the transmit power of FBS. 
Note that the benchmark scheme could finally catch up our 
schemes at the cost of very high FBS power. However, even 
with little transmit power at each FBS, the proposed schemes 
can achieve very high secrecy rate, which is in sharp contract 
to the benchmark scheme. This indicates that STB-SMF and 
STB-JMF are able to achieve a better R s without the need to 
increase the transmit power of each cooperative FBS. In order 
to better illustrate the behaviors of STB-SMF and STB-JMF, 
we plot the secrecy rate of MUi versus the transmit power 
of the MBS and one cooperative FBS in a three-dimensional 
figure in Fig. [9] where we can observe the variation tendency 
of secrecy rate more clearly. 


Fig. 8. The secrecy rate of MUi versus the transmit power of each FBS. 



Transmit Power of FBS (dBm) Transmit Power of MBS (dBm) 

Fig. 9. The secrecy rate region of MUi versus the transmit power of the 
MBS and each FBS. 


Fig. [10| shows that the averaged SINR of FUs versus the 
transmit power of the MBS when there is an eavesdropper 
wiretapping MUi. Due to symmetry, we only need to evaluate 
the averaged SINR of the FU in one cooperative femtocell, 
and we assume the SINR requirement of FUs in STB-JMF 
scheme is 0.60. From Fig. [lOl it is observed that the SINR 
of FUs in STB-JMF achieves its optimum and is significantly 
superior to that in STB-SMF. We can also conclude that the 
SINR constraints (124dl) in STB-JMF hold with equality. But 
for the STB-SMF scheme, as the transmit power of the MBS 
increases, the SINR of FUs goes down dramatically because 
more interference is introduced at FUs. 

Fig. El shows the averaged SINR of each FU versus the 
transmit power of each FBS when there is an eavesdropper 
wiretapping MUi. Similarly, the SINR requirement of FUs in 
STB-JMF is set as 0.60. We can also see that STB-JMF has 
advantages related to the averaged SINR of FU. It is worth 
noting that when the transmit power of each FBS is relatively 
low, e.g., around 20 dBm, the SINR constraint in STB-JMF 
could not be satisfied and thus there is no optimal solution. 
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Fig. 12. Two-user interference channel with an eavesdropper. 


Fig. 10. The receive SINR of FUs versus the transmit power of the MBS. 



Fig. 11. The receive SINR of FUs versus the transmit power of each FBS. 


Hence, we slightly decrease the SINR requirement of FUs to 
0.5 to ensure that the optimization problem can be solved. So 
in Fig. nu at the point of 20dBm, we can see the averaged 
SINR decreases slightly. However, from Fig. [TOj and HU we 
can clearly see that the benefit of STB-JMF is to maximize 
secrecy rate of the wiretapped MU while maintaining QoS for 
ah related FUs and the intended MU. 

C. Impact of Artificial Noise (AN) on the Proposed Schemes 

AN plays an important role in the physical layer security 
and may achieve substantial secrecy performance in some 
scenarios. In what follows we provide some simulations to 
verify whether AN is still beneficial for our schemes. To this 
end, AN is introduced into the STB-OM, the STB-SMF and 
the STB-JMF in these simulations. Furthermore, except for 
the beamforming schemes proposed in this paper, we also 
present two additional schemes for the purpose of comparison 
in these simulations, which are the “joint beamforming and 
AN design”, as well as the “beamforming design with random 
AN”. 

Let us consider the broadcast channel as an example, then 


the optimization problem of “joint beamforming and AN 
design” can be expressed as 


max log(l + SINRi) — log(l + SINR#) (34a) 

{w m }^ =1 ,z 

s.t. SINR m > 7m , m G [2, M ], (34b) 

M 

£||w m || 2 +||z||<P M , (34c) 

m= 1 


where SINR m and SINR# are the received SINRs at MU m 
and at the eavesdropper E , respectively. These SINRs are 
given by 


SINR m 


|hmW« 


\ h mW q \ Z + I h m z 


'M 


2 ’ 


(35) 


SINR b = 


_ |h £ wi | 2 _ 

°E + EL |hsW m | 2 + |h B z | 2 ’ 


(36) 


where z is the AN vector. Hence, we can solve this optimiza¬ 
tion problem using Algorithm 1 proposed in this paper. Note 
that this model mimics the effect of AN in the STB-OM. 

On the other hand, considering the “beamforming design 
with random AN” for the broadcast channel, we transmit 
random AN and the optimized beamforming vectors at the 
MBS. The optimization problem is similar to (l34l) except that 
the optimization variables are only {w m }^f =1 , which do not 
include z. 

Note that the STB-SMF and the STB-JMF rely on an 
interference channel. For simplicity, we only consider the 
typical scenario where there are two transmitters each having 
four antennas, two receivers each having a single antenna and 
one single-antenna eavesdropper trying to wiretap one of the 
transmitters, as shown in Fig. [121 

We present the simulation results for the broadcast channel 
(as shown in Fig. ns and for the interference channel (as 
shown in Fig. m. From Fig. [13] and Fig. [141 we can see 
that the secrecy rate of the system is almost the same for the 
proposed schemes whether there exists AN (joint design) or 
not. Therefore, we can conclude that transmitting AN using the 
additional Nm — M dimensions does not have any significant 
impact on the performance of the proposed schemes. This is 
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Fig. 13. The secrecy rate versus the transmit power of the MBS in the 
broadcast channel with/without AN. 


- 1 - 1 beamforming design for interference channel 
O joint beamforming and AN design for interference channel 
-Q- 1 beamforming design with random AN for interference channel 


X 


Transmit power of transmitters/dB 


Fig. 14. The secrecy rate versus the transmit power of transmitters in the 
interference channel with/without AN. 


because in the proposed STB-OM scheme, we assume that 
there are multiple MUs, thus the MBS has to transmit multiple 
data flows. Therefore, the STB-OM relies on a broadcast 
channel. At the eavesdropper, the data from other legitimate 
MUs can be regarded as interference. For the STB-SMF and 
the STB-JMF, the data from FBSs can also be treated as 
interference. These interferences are essentially equivalent to 
the special ANs imposed on the eavesdropper. 

V. Conclusions 

In this paper, we have investigated the physical-layer secu¬ 
rity schemes in a two-tier downlink HetNet. On the basis of the 
two suggested spectrum allocation strategies, the OSA and the 
SONOSA, three STB schemes, i.e., STB-OM, STB-SMF and 
STB-JMF, have been proposed to maximize the secrecy rate 
of the eavesdropped user. According to various considerations 
of the QoS requirements of the legitimate users, the three 
proposed secrecy schemes adopt different degrees of collab¬ 
oration among MBS and its cooperative FBSs. In particular, 
the complicated nonconvex STB optimization problems have 


been solved by problem reformulations with SDP and SOCP 
techniques. Simulation results show the effectiveness of the 
proposed schemes. For the future work, it would be interesting 
to consider the scenario where multiple eavesdroppers and/or 
targeted MUs exist in the HetNet. Additionally, the robust STB 
schemes in the context of imperfect CSI may be investigated. 


Appendix 

Proof Of Proposition 1 

The maximization problem (l32l) can be equivalently trans¬ 
formed into 


min Tr(H#Xi) (37a) 

{{XndLl}n = l 


M 

s.t. ]T Tr(X m ) < PmC, (37b) 

m= 1 
K 

E Tr(X n fc) < P F C,n G [1, N], (37c) 

k=1 

M 

Tr(H m X m ) > 7m ( ^ Tv(U m X q ) 

<7=1, 

q^m 

N K 

+ Tr(H n?m X n / c ) + (),mE [2, M], 

n=1 k =1 

(37d) 


K 

Tr(H njn feX n jfe) > 'Jnk ( y ^ Tl’(H ri;n / c X n f;) 

7 = 1 , 

t^k 

N K 

+ EE Tr ( H p,nk^pt) 

p= 1 7=1 

p^n 

M 

+ ^TV(H nfc X m ) + C), 

m=1 

n G [1, N],k G [1, K], (37e) 

M 

^(HiXi) > r( Y, ^(H m X m ) 

m=2 

N K 

+ EE Tr ( H «.lXnfc) + C), (37f) 

n= 1 k= 1 
M 

Y, TV(H s X m ) 

m=2 

N K 

+ E E Tr(H„, B X nfe ) + C = 1, (37g) 

n=1 k =1 

X m ,X n ^0,(>0. (37h) 


It is easy to verify that Problem (f37l) satisfies the Slater’s 
condition. Then, the Karush-Kuhn-Tucker (KKT) conditions 
are the sufficient and necessary optimality conditions. Some 
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KKT conditions needed in the proof are expressed as follows: 

M 

Gl = a*I + H E + 

m =2 

N K 

+ ^2 C n/c7n/cH nk d Hi, (38a) 

n=1k=1 


GiXi = 0 , 



(38b) 


M 

N K 


Gm = a*I + 

E + 

c nklnk^-nk 



n= 1 k= 1 


+ d*rH, 

m + e*H E - b* m 

H mi m 1, 

(38c) 

G„X m = 0 , ra 7 ^ 1 , 


(38d) 


M 

K 


g;*=<i+ 

^ ] ^m7mH n ,m + ^ ^ c n tlnt^-n,nt 



m— 2 

t^fk 



N K 

H - ^ ^ Cpklfpk^-n,pk H - d rH n ,i 

/c=l 

n e [1, N],k € [1, if], (38e) 

G* nk X nk ^O,ne[l,N],ke[l,K\, (38f) 

where G* m ^ 0 , m e [1,M], G* fe ^ 0 , n e [1 ,N],k e 
[1 ,K], a* > 0, a* n > 0, & m > 0, c„ fc > 0, d > 0, e > 0 

are the optimal dual variables associated with the constraints 
X m 5 ~^-nk 0 and dJ7bl)-(|37gl), respectively. 

Note that (138alh (I38cl) and (138el) have a similar structure, 
hence we only focus on the proof of rank(X^) = 1. 
rank(X^) = 1, m G [2,M], and rank(X* fc ) = 1, n G 
[1, AT], k G [1, AT], can be proved by using the same method. 

If XJ =0, the resultant secrecy rate is zero, which is trivial. 
Then, we have X* ^ 0. According to (138bL the rank of G* 
must be less than or equal to n — 1 , i.e., 

rank(G^) < n — 1. (39) 

An important observation is that with the optimal solution, 
the power constraints (I37bb and (137cl) have to be satisfied with 
equality 1421 . Therefore, we have a* > 0 and a* > 0 , n G 
[1,7V]. Let 

M N K 

V = a I + He + ^2 ^m 7 mH m + C n/c7n/cH n / c 

m =2 n=l /c=l 

= (V5)Vo, (40) 

i / ah 

where V 2 = ( V 2 J e 0, then the rank of G^ can be further 
expressed as 

rank(G^) = rank(V — d*Hi) 

= rank (v? (I-d*Hi)V3) 

= rank (i - 

> n — 1, (41) 

where the equation a holds true relying on the following fact 
rank(B) = rank(AB) = rank(BC) = rank(ABC), (42) 


where A mxm and C nxn are both non-singular matrices, and 
B mxn is an arbitrary matrix. 

From ([39b and (1411) . we have rank(GJ) = n — 1. Ac¬ 
cording to (I38bb . we have rank(X^) < dim(A/’(G*)) = 
n — rank(G^) = 1. Since X^ / 0, we obtain rank(X^) = 1 . 

Following the same procedure, we are capable of proving 
that rank(X^) = 1, m G [2 ,M], and rank(X* /c ) — 1, n G 
[1, TV], k G [1, AT]. Hence, we have completed the proof. 
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